Super-resolution image acquisition methods and apparatus

ABSTRACT

Embodiments of the present application disclose various super-resolution image acquisition methods and apparatus. One of the super-resolution image acquisition methods comprises: acquiring an image of a to-be-shot scene by an image sensor; changing pixel point distribution of the image sensor at least once; separately acquiring an image of the to-be-shot scene by the image sensor changed each time; and acquiring a super-resolution image of the to-be-shot scene according to the acquired images. According to the embodiments of the present application, by fusing multiple differentiated images of the same scene acquired by a single image sensor in different time periods, a super-resolution image is acquired. The solution is simple and easy to implement, and may better meet users&#39; diversified actual application needs.

RELATED APPLICATION

The present international patent cooperative treaty (PCT) applicationclaims the benefit of priority to Chinese Patent ApplicationNo.201410521674.6, filed on Sep. 30, 2014, and entitled“Super-resolution Image Acquisition Methods and Apparatuses,” which isherein incorporated into the present international PCT application byreference in its entirety.

TECHNICAL FIELD

The present application relates to the field of image processingtechnologies, and in particular, to various super-resolution imageacquisition methods and apparatus.

BACKGROUND

Resolution is one of the important indexes for evaluating image quality.To improve image resolution, software processing may be performed onmultiple low-resolution images obtained by photographing the same scenewhose contents are similar but spatio and/or temporal information is notcompletely the same, to generate a super-resolution image.

Super-resolution images are widely used, for example, a super-resolutionimage may be applied to, but is not limited to: restoring high frequencyinformation lost in different acquisition scenes, such as out-of-focus,motion blur, non-ideal sampling, etc., and even can be configured torestore high frequency spatial information beyond a diffraction limit ofan optical system. Therefore, the study on a technology of acquiring asuper-resolution image attracts general attention of technicalpersonnel.

SUMMARY

A brief summary about the present application is given hereinafter, soas to provide a basic understanding about certain aspects of the presentapplication. It should be understood that the summary is not anexhaustive summary about the present application. It is neither intendedto determine critical or important parts of the present application, norintended to limit the scope of the present application. Its purpose ismerely giving some concepts in a simplified form, to be taken as thepreamble to be described later in more detail.

The present application provides various super-resolution imageacquisition methods and apparatus.

In one aspect, embodiments of the present application provide asuper-resolution image acquisition method, comprising:

acquiring an image of a scene by an image sensor;

changing pixel point distribution of the image sensor at least once;

separately acquiring an image of the scene by the image sensor changedeach time; and acquiring a super-resolution image of the scene accordingto the acquired images.

In another aspect, the embodiments of the present application furtherprovide a super-resolution image acquisition apparatus, comprising:

an original image acquisition module, configured to acquire an image ofa scene by an image sensor;

a pixel point distribution change module, configured to change pixelpoint distribution of the image sensor at least once;

an adjustment image acquisition module, configured to separately acquirean image of the scene by the image sensor changed each time; and

a super-resolution image acquisition module, configured to acquire asuper-resolution image of the scene according to the acquired images.

According to the technical solutions provided in the embodiments of thepresent application, an image is acquired by an image sensor beforepixel point distribution is adjusted, then the pixel point distributionof the image sensor is changed at least once, and after each change, animage of the same scene is then separately acquired by the changed imagesensor. This is equivalent to acquiring a group of images of the samescene at different time periods, which are similar in content but notcompletely the same in acquired information about details. Asuper-resolution image may be generated by performing softwareprocessing such as fusing on this group of images, and resolution of thesuper-resolution image is higher than that of each image of the group ofimages. In view of this, according to the technical solutions providedin the embodiments of the present application, a super-resolution imagemay be acquired without using multiple cameras or multiple imagesensors, and the solutions are simple and easy to implement, and maybetter meet users' diversified actual application needs.

These and other advantages of the present application will be moreevident through the following detailed description about optionalembodiments of the present application with reference to theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The present application can be better understood with reference to thedescription given below in combination with the accompanying drawings,in which the same or similar reference signs are used in all thedrawings to indicate the same or similar components.

The drawings together with the following detailed description arecomprised in the specification and form a part of the specification, andare configured to further exemplify alternative embodiments of thepresent application and explain the principle and advantages of thepresent application. In the drawings:

FIG. 1a is a flowchart of a super-resolution image acquisition methodaccording to one embodiment of the present application;

FIG. 1b is a schematic structural diagram of a first image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 1c is a schematic structural diagram of a second image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 1d is a schematic structural diagram of a third image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 1e is a schematic structural diagram of a fourth image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. if is an example of a scene where an image sensor adjusts pixeldensity in the event of uneven light field excitation according to oneembodiment of the present application;

FIG. 1g is a schematic structural diagram of a fifth image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 1h is a schematic structural diagram of a sixth image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 1i is a schematic structural diagram of a seventh image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 1j is a schematic structural diagram of an eighth image sensor withadjustable pixel density according to one embodiment of the presentapplication;

FIG. 2a is an example of an image acquired by an image sensor in whichpixel points are distributed evenly according to one embodiment of thepresent application;

FIG. 2b is an example of an image acquired by an image sensor in a stateafter even distribution of pixel points is changed according to oneembodiment of the present application;

FIG. 2c is an example of an image acquired by an image sensor in anotherstate after even distribution of pixel points is changed according toone embodiment of the present application;

FIG. 2d is an example of a super-resolution image according to oneembodiment of the present application;

FIG. 3 is a logic block diagram of a super-resolution image acquisitionapparatus according to one embodiment of the present application;

FIG. 4 is a logic block diagram of another super-resolution imageacquisition apparatus according to one embodiment of the presentapplication;

FIG. 5 is a logic block diagram of a first region determination moduleaccording to one embodiment of the present application; and

FIG. 6 is a logic block diagram of a further super-resolution imageacquisition apparatus according to one embodiment of the presentapplication.

Those skilled in the art should understand that, elements in theaccompanying drawings are merely shown for simplicity and clearness, andmay not be drawn proportionally. For example, the sizes of some elementsin the accompanying drawings may be enlarged relative to other elements,so as to help to improve understanding of the embodiments of the presentapplication.

DETAILED DESCRIPTION

Exemplary embodiments of the present application are described below indetail with reference to the accompanying drawings. For the sake ofclarity and simplicity, not all the features of actual implementationsare described in the specification. However, it should be understoodthat, lots of decisions specific to implementations must be made duringdevelopment of any such actual embodiment, so as to achieve specificgoals of developers, for example, restrictions relevant to systems andservices are met, and the restrictions may vary with differentimplementations. In addition, it should also be understood that,although development work is likely to be very complicated andtime-consuming, for those skilled in the art who benefit from thedisclosure, the development work is merely a routine task.

Herein, it should also be noted that, in order to avoid blurring thepresent application due to unnecessary details, only apparatusstructures and/or processing steps closely related to solutionsaccording to the present application are described in the accompanyingdrawings and the specification, but representation and description aboutmembers and processing having little to do with the present applicationand known to those of ordinary skill in the art are omitted.

Specific implementations of the present application are furtherdescribed in detail below with reference to the accompanying drawings(in which like elements are denoted by like reference numerals) andembodiments. The following embodiments are intended to describe thepresent application, but not to limit the scope of the presentapplication.

It should be understood by those skilled in the art that the terms suchas “first” and “second” in the present application are merely intendedto distinguish different steps, devices or modules, etc., which neitherrepresent any particular technical meaning nor indicate a necessarylogical sequence between them.

FIG. 1a is a flowchart of a super-resolution image acquisition methodaccording to one embodiment of the present application. Thesuper-resolution image acquisition method provided in this embodiment ofthe present application may be performed by a super-resolution imageacquisition apparatus, and the super-resolution image acquisitionapparatus may perform static or dynamic image processing control byexecuting the super-resolution image acquisition method duringapplications, which comprise, but are not limited to, phototaking,camera shooting, photographing, and video monitoring. A devicepresentation form of the super-resolution image acquisition apparatus isnot limited. For example, the super-resolution image acquisitionapparatus may be a separate part, and the part cooperates andcommunicates with an imaging device such as a camera, a video camera, amobile phone, or a wearable camera; or, the super-resolution imageacquisition apparatus may be integrated into an imaging device as afunctional module, which is not limited in this embodiment of thepresent application.

Specifically, as shown in FIG. 1 a, a super-resolution image acquisitionmethod provided in this embodiment of the present application comprises:

S101: Acquire an image of a to-be-shot scene by an image sensor.

In an initial state, pixel points of the image sensor are distributedevenly. By performing processing such as focus and exposure on ato-be-shot scene by an imaging device such as a camera, a mobile phone,or a video camera, an image of the to-be-shot scene may be acquired byan image sensor, in which pixel points are distributed evenly, of theimaging device. Resolution of different parts of the acquired image isthe same.

S102: Change pixel point distribution of the image sensor at least once,and separately acquire an image of the to-be-shot scene by the imagesensor changed each time.

The image sensor is an image sensor in which pixel point distribution isadjustable, for example, a flexible image sensor. The flexible imagesensor comprises a flexible substrate and multiple image sensor pixels(that is, pixel points) forming on the flexible substrate, where theflexible substrate may make changes such as expansion and contraction,or bending to adjust relative position distribution of pixel points ofthe flexible substrate when meeting a certain condition.

The pixel point distribution of the image sensor may be adjusted once ormany times, so as to change the pixel point distribution of the imagesensor once or many times. After each change, the pixel pointdistribution of the image sensor is uneven distribution, and currentpixel point distribution of the image sensor is different from any pixelpoint distribution changed before.

Each time the pixel point distribution of the image sensor is changed,an image of the to-be-shot scene is acquired by the image sensor withchanged pixel point distribution. If the pixel point distribution of theimage sensor is changed many times, after the pixel point distributionis changed each time, an image of the to-be-shot scene will be acquiredby the image sensor with changed pixel point distribution each time.

Pixel points of the image sensor after the pixel point distribution ischanged are distributed unevenly. Therefore, among images of theto-be-shot scene separately acquired by the image sensor, resolution ofdifferent parts of each image may have differentiated distribution. Forexample, a local part is relatively clear, while another local part isrelatively unclear.

S103: Acquire a super-resolution image of the to-be-shot scene accordingto the acquired images.

After S101 to S102, at least two images may be acquired, that is, animage acquired by the image sensor in a state in which pixel points aredistributed evenly, where resolution of different parts of the image isthe same; and at least one image acquired by the image sensor in a statein which at least one pixel point is distributed unevenly, whereresolution of different parts of each of the at least one image may havedifferentiated distribution, and resolution of a local part of the imageis high while resolution of another local part of the image is low.

The acquired at least two images form a group of images which areobtained by shooting the same scene, and similar in content but notcompletely the same in acquired information about details. Asuper-resolution image may be generated by performing softwareprocessing such as fusing on such a group of images, and resolution ofthe super-resolution image is higher than that of each image of thegroup of images.

According to the technical solutions provided in the embodiments of thepresent application, an image is acquired by an image sensor beforepixel point distribution is adjusted, then the pixel point distributionof the image sensor is changed at least once, and after each change, animage of the same scene is then separately acquired by the changed imagesensor. This is equivalent to acquiring a group of images of the samescene at different time periods, which are similar in content but notcompletely the same in acquired information about details. Asuper-resolution image may be generated by performing softwareprocessing such as fusing on this group of images, and resolution of thesuper-resolution image is higher than that of each image of the group ofimages. In view of this, according to the technical solutions providedin the embodiments of the present application, a super-resolution imagemay be acquired without using multiple cameras or multiple imagesensors, and the solutions are simple and easy to implement, and maybetter meet users' diversified actual application needs.

In the foregoing technical solution, a method for changing pixel pointdistribution of the image sensor is very flexible, which is not limitedin this embodiment of the present application.

An optional implementation of changing the pixel point distribution ofthe image sensor is aimed at changing the pixel point distribution ofthe image sensor from an initial state of even distribution to an unevendistribution state, so as to adjust the pixel point distribution of theimage sensor flexibly.

For example, the changing pixel point distribution of the image sensorat least once comprises increasing an average pixel point density of afirst imaging region of the image sensor at least once.

In this embodiment of the present application, the first imaging regionis a part of an imaging region of the image sensor; which part of theimaging region of the image sensor the first imaging region isspecifically may be determined randomly or determined according to anactual need, and the determining manner is very flexible and is notlimited in this embodiment of the present application. For example, thefirst imaging region may be a continuous distribution region of theimage sensor, and may be, but is not limited to a central region, atop-left-corner region, a bottom-right-corner region, or the like of theimage sensor. For example, the first imaging region may comprisemultiple imaging sub-regions, and the multiple imaging sub-regions aredispersively distributed in the image sensor, for example, multipleimaging sub-regions of the image sensor, such as a top-left imagingsub-region, a bottom-left imaging sub-region, a top-right imagingsub-region, and a bottom-right imaging sub-region are used as the firstimaging region in this embodiment of the present application.

According to the solution, the pixel point distribution of the imagesensor is adjusted, to cause the number of pixel points in the firstimaging region of the image sensor to increase and the pixel points tobe distributed more densely, that is, an average pixel point density ofthe first imaging region increases. At this time, a sub-image,corresponding to the first imaging region, in an image of the same sceneacquired by the image sensor is richer in details and higher inresolution, while resolution of other sub-images of the image is lower,thereby forming an image in which resolution is distributed variedly.The pixel point distribution of the image sensor may be adjusted once;or the pixel point distribution of the image sensor may be adjusted manytimes. For example, an average pixel point distribution density may beincreased successively. For example, an average pixel point density ofan image sensor adjusted next time is greater than an average pixelpoint density of the image sensor adjusted last time.

In this embodiment of the present application, after pixel pointdistribution of the image sensor is changed at least once, pixel pointswithin the first imaging region are distributed evenly or unevenly. Thatis to say, after the pixel point distribution of the image sensor ischanged each time, pixel points within the first imaging region may beevenly distributed at equal intervals, and may also be distributedunevenly, that is, a part is sparse while a part is dense, which is notlimited in this embodiment of the present application.

For example, the changing pixel point distribution of the image sensorat least once comprises decreasing an average pixel point density of thefirst imaging region of the image sensor at least once.

According to the solution, pixel points in the first imaging region ofthe image sensor are decreased, to cause the pixel points within thefirst imaging region to be sparser. Because the image sensor is a whole,if an average pixel point density of the first imaging region decreases,an average pixel point density of another imaging region of the imagesensor (which might as well be referred to as “a second imaging region”)except the first imaging region increases. Resolution of a sub-image,corresponding to the first imaging region, in an image of the same sceneacquired by the image sensor is lower, while a sub-image correspondingto the second imaging region is richer in details and higher inresolution, thereby forming an image in which resolution is distributedvariedly.

The pixel point distribution of the image sensor may be adjusted once;or the pixel point distribution of the image sensor may be adjusted manytimes. For example, an average pixel point distribution density may bedecreased successively. As an example, an average pixel point density ofan image sensor adjusted next time is less than an average pixel pointdensity of the image sensor adjusted last time, etc.

For example, the changing pixel point distribution of the image sensorat least once comprises increasing an average pixel point density of thefirst imaging region of the image sensor at least once, and decreasingan average pixel point density of the first imaging region of the imagesensor at least once. For example, an image a as shown in FIG. 2a may beacquired by an image sensor in which pixel points are distributedevenly; then, an average pixel point density of the first imaging regionis increased once (or many times), and an image b of the same scene isacquired by the image sensor obtained after increase, and resolution ofa sub-image, corresponding to the first imaging region, of the image bis higher, while resolution of a sub-image corresponding to a secondimaging region is lower, as shown in FIG. 2b ; and afterwards, anaverage pixel point density of the first imaging region is decreasedonce (or many times), and an image c of the same scene is acquired bythe image sensor obtained after decrease, and resolution of a sub-image,corresponding to the first imaging region, of the image c is lower,while resolution of a sub-image corresponding to the second imagingregion is higher, as shown in FIG. 2c . The acquired at least two imagesare fused. For example, the image a, the image b, and the image c arefused, and details of the images complement each other. A part, whichlacks details, of one image may be complemented by another image, anddetails of different parts of a scene are refined to varying degrees,which is equivalent to improving resolution of an image, composed ofdifferent parts, of the same scene, thereby obtaining a super-resolutionimage d. As shown in FIG. 2d , resolution of the super-resolution imaged is higher than resolution of any one of the image a, the image b, andthe image c.

Another optional implementation of changing the pixel point distributionof the image sensor is aimed at performing targeted adjustment on animaging region, which corresponds to a local part of a to-be-shot scene,of the image sensor, so as to adjust the pixel point distribution of theimage sensor flexibly.

For example, the acquisition method further comprises: determining animaging region, corresponding to a first region, of the image sensor.The first region is a local part of the to-be-shot scene.Correspondingly, the changing pixel point distribution of the imagesensor at least once comprises: changing pixel point distribution of thedetermined imaging region at least once.

When an image of a to-be-shot scene is acquired by an image sensor,pixels of the image sensor are evenly distributed, and image resolutionof different regions of the scene acquired by the image sensor is thesame. However, in some scenes, generally, different regions of the sceneare of different significance and/or importance for a user, that is, theuser has different requirements for imaging quality of different regionsof the to-be-shot scene. For example, in a character shooting scene, auser is more interested in a human face in the scene than in scenery inthe scene, and therefore, has higher requirements for resolution ofhuman face imaging.

To this end, this embodiment of the present application provides amanner of, for a local part of a to-be-shot scene (that is, the firstregion), changing an imaging region, corresponding to the first region,of an image sensor and acquiring images of the same scene many times indifferent time periods, to acquire a group of images of the same scenethat are similar in content but different in richness of details of asub-image corresponding the first region. Optionally, the changing pixelpoint distribution of the determined imaging region at least oncecomprises: increasing an average pixel point density of the determinedimaging region at least once. At least one image with higher resolutionand richer details is acquired by increasing the average pixel pointdensity of the determined imaging region. By combining imaging of theimages, a super-resolution image of the same scene is acquired, whichmay improve imaging quality of a part, corresponding to the firstregion, of the acquired super-resolution image.

Optionally, in the technical solution provided in this embodiment of thepresent application, the super-resolution image acquisition methodfurther comprises: determining the first region. According to thesolution, a local part (for example, a region with higher requirementsfor image spatial resolution, or a region with lower requirements forimage spatial resolution) of a current to-be-shot scene may bepredetermined as the first region according to an actual need, which maybetter meet users' personalized application needs.

The manner of determining the first region is very flexible and is notlimited in this embodiment of the present application. An optionalimplementation manner may be that the first region is determinedaccording to a preview image of the to-be-shot scene acquired by theimage sensor. According to the solution, the first region is determinedbased on the preview image, which may improve convenience of use for auser.

A specific implementation of determining the first region based on thepreview image is also very flexible.

For example, the first region may be determined according to informationof a region of interest (ROI) of the preview image, that is, ROIdetermination information may be acquired based on a preview image ofthe image sensor about the to-be-shot scene; and a region, correspondingto the ROI determination information, of the to-be-shot scene isdetermined as the first region. The ROI region may comprise, but is notlimited to, one or more of the following: at least one region, selectedby a user, of the preview image (that is, a user selection region of thepreview image), at least one region, gazed by a user, of the previewimage (that is, a user gaze region of the preview image), and an ROIobtained by the image sensor by automatically detecting the previewimage. According to the solution, according to the ROI of the previewimage, a local part, corresponding to the ROI, of the to-be-shot sceneis determined as the first region, to cause determination of the firstregion to more fit in with actual user demands, which can better meetusers' personalized application demands.

For example, the first region may be automatically determined accordingto an image analysis result of the preview image, that is, an imageanalysis is performed on a preview image of the image sensor about theto-be-shot scene; and the first region is determined according to aresult of the image analysis. In an optional scene, human facerecognition may be performed on the preview image, and according to arecognition result, a human face region, corresponding to a human faceimage, of the to-be-shot scene is determined as the first region.According to the solution, a region, corresponding thereto, of theto-be-shot scene may be determined as the first region according to animage analysis result of the preview image, to cause determination ofthe first region to be more intelligent, thereby improving efficiencyand universality of the determination of the first region.

According to this embodiment of the present application, after an imageof the to-be-shot scene is acquired by an image sensor in which pixelpoints are distributed evenly, pixel point distribution of the imagesensor may be changed at least once, so as to acquire at least one otherimage of the same scene by the image sensor in at least one state inwhich pixel points are distributed differently. A manner of changing thepixel point distribution of the image sensor may be selected flexiblyaccording to an actual need, which is not limited in this embodiment ofthe present application. In an optional implementation manner, the imagesensor comprises a controllable deformed material portion, anddeformation control information of the controllable deformed materialportion of the image sensor may be determined according to an expectedstate of pixel point distribution; and according to the deformationcontrol information, the controllable deformed material portion may becontrolled to produce deformation, so as to adjust pixel pointdistribution of the image sensor correspondingly according to thedeformation of the controllable deformed material portion. According tothe solution, the pixel point distribution of the image sensor isadjusted by controlling the deformation of the controllable deformedmaterial portion. The solution is simple and easy to implement.

The controllable deformed material portion can produce deformation bychanging a certain external effect factor (such as an external field)acting on the controllable deformed material portion, and when theexternal field acting thereon is cancelled or changed, the deformationof the controllable deformed material portion can be restored.

FIG. 1b is a schematic structural diagram of an image sensor withadjustable pixel density according to one embodiment of the presentapplication. As shown in FIG. 1 b, the image sensor with adjustablepixel density provided in this embodiment of the present applicationcomprises multiple image sensor pixels 11 and a controllable deformedmaterial portion 12. The image sensor performs image acquisition by theimage sensor pixels 11, the multiple image sensor pixels 11 arearray-distributed, and the controllable deformed material portion 12 isseparately connected to the multiple image sensor pixels 11; and thecontrollable deformed material portion 12 may produce deformation underthe action of an external field, and density distribution of themultiple image sensor pixels 11 is adjusted correspondingly through thedeformation of the controllable deformed material portion 12.

In the technical solution provided in this embodiment of the presentapplication, the controllable deformed material portion can producedeformation by changing a certain external field effect factor on thecontrollable deformed material portion, when the certain external fieldeffect factor is cancelled or changed, the deformation of thecontrollable deformed material portion can be restored, and acorresponding control external field acting thereon may be selected asthe external field with respect to deformation characteristics of thecontrollable deformed material portion, for example, the external fieldcomprises, but is not limited to, an external electric field, a magneticfield, a light field and the like. The image sensor pixels may comprise,but are not limited to, at least one photoelectric conversion unit. Eachof the image sensor pixels and the controllable deformed materialportion may be closely connected in a manner which comprises, but is notlimited to, adhesion, in this way, when the controllable deformedmaterial portion produces deformation, spacing between the image sensorpixels will be adjusted correspondingly, thus changing densitydistribution of the image sensor pixels and achieving the effect ofgiving differentiated pixel density distribution to different regions ofthe image sensor according to actual requirements.

During actual applications, an unevenly distributed external field canact on different regions of the controllable deformed material portion,to cause different regions of the controllable deformed material portionto produce deformation differently, thus adjusting the overall densitydistribution of the image sensor pixels. Optionally, the external fieldcan act on a region where the controllable deformed material portion andthe multiple image sensor pixels do not overlap, to cause a region wherethe controllable deformed material portion and the image sensor pixelsoverlap not to produce deformation, the density distribution of theimage sensor pixels is changed through deformation of other parts of thecontrollable deformed material portion, and the solution helps to avoiddamage to the image sensor pixels caused by deformation of thecontrollable deformed material portion.

During actual applications, at least one suitable controllable deformedmaterial can be selected as required to prepare the controllabledeformed material portion, to cause the controllable deformed materialportion to have characteristics of being deformable and havingrecoverable deformation. Optionally, the controllable deformed materialportion is at least prepared from at least one or more of the followingcontrollable deformed materials: piezoelectric materials, electroactivepolymers, photodeformation materials and magnetostriction materials.

The piezoelectric material may produce mechanical deformation due to theaction of an electric field. A controllable deformed material portionprepared based on the piezoelectric material is hereinafter referred toas a piezoelectric material portion. By use of such a physical propertyof the piezoelectric material, the embodiment of the present applicationcan determine electric field control information configured to make thepiezoelectric material portion produce corresponding mechanicaldeformation according to, but not limited to, the target pixel densitydistribution information, control an electric field acting on thepiezoelectric material portion according to the electric field controlinformation, to cause the piezoelectric material portion to producecorresponding mechanical deformation, and correspondingly adjust pixeldensity distribution of the image sensor through the mechanicaldeformation of the piezoelectric material portion, thus achieving thepurpose of adjusting pixel density distribution of the image sensoraccording to the target pixel density distribution information. Thepiezoelectric materials may comprise, but are not limited to, at leastone of the following: piezoelectric ceramic and piezoelectric crystal.The solution can make full use of the physical property of thepiezoelectric material to adjust pixel density distribution of the imagesensor.

The Electroactive Polymers (referred to as EAPs) are one kind of polymermaterials that can change their shapes or sizes under the action of anelectric field. The controllable deformed material portion prepared fromthe EAPs is hereinafter referred to as an EAP portion. By use of such aphysical property of the EAPs, the embodiment of the present applicationcan determine electric field control information configured to make theEAP portion produce corresponding deformation according to, but notlimited to, the target pixel density distribution information, controlan electric field acting on an EAP layer according to the electric fieldcontrol information, to cause the EAP layer to produce correspondingdeformation, and correspondingly adjust pixel density distribution ofthe image sensor through the deformation of the EAP layer, thusachieving the purpose of adjusting pixel density distribution of theimage sensor according to the target pixel density distributioninformation. The EAP materials may comprise, but are not limited to, atleast one of the following: electronic EAPs and ionic EAPs; theelectronic EAPs comprise at least one of the following: ferroelectricpolymers (such as polyvinylidene fluoride), electrostrictive graftedelastomers and liquid crystal elastomers; and the ionic EAPs comprise atleast one of the following: electrorheological fluids, ionicpolymer-metallic composite materials and the like. The solution can makefull use of the physical property of the EAPs to adjust pixel densitydistribution of the image sensor.

The photodeformation materials are one kind of polymer materials thatcan change their shapes or sizes under the action of a light field. Thecontrollable deformed material portion prepared from thephotodeformation materials is hereinafter referred to as aphotodeformation material portion. By use of such a physical property ofthe photodeformation materials, the embodiment of the presentapplication can determine light field control information configured tomake the photodeformation material portion produce correspondingdeformation according to, but not limited to, the target pixel densitydistribution information, control a light field acting on thephotodeformation material portion according to the light field controlinformation, to cause the photodeformation material portion to producecorresponding deformation, and correspondingly adjust pixel densitydistribution of the image sensor through the deformation of thephotodeformation material portion, thus achieving the purpose ofadjusting pixel density distribution of the image sensor according tothe target pixel density distribution information. The photodeformationmaterials may comprise, but are not limited to, at least one of thefollowing: photostrictive ferroelectric ceramics and photodeformationpolymers; the photostrictive ferroelectric ceramics comprise, but arenot limited to, lead lanthanum zirconate titanate (PLZT) ceramics, andthe photodeformation polymers comprise, but are not limited to,photodeformation liquid crystal elastomers. The solution can make fulluse of the physical property of the photodeformation material to adjustpixel density distribution of the image sensor.

The magnetostriction materials are one kind of magnetic materials thatcan change a magnetization state thereof under the action of a magneticfield and then change their sizes. The controllable deformed materialportion prepared from the magnetostriction materials is hereinafterreferred to as a magnetostriction material portion. By use of such aphysical property of the magnetostriction materials, the embodiment ofthe present application can determine magnetic field control informationconfigured to make the magnetostriction material produce correspondingdeformation according to, but not limited to, the target pixel densitydistribution information, control a magnetic field acting on themagnetostriction material portion according to the magnetic fieldcontrol information, to cause the magnetostriction material portion toproduce corresponding deformation, and correspondingly adjust pixeldensity distribution of the image sensor through the deformation of themagnetostriction material portion, thus achieving the purpose ofadjusting pixel point distribution of the image sensor according to thetarget pixel density distribution information. The magnetostrictionmaterials may comprise, but are not limited to, rare-earth giantmagnetostrictive materials, such as alloy Tbo_(0.3)Dy_(0.7)Fe_(1.95)materials using a (Tb,Dy)Fe₂ compound as a substrate. The solution canmake full use of the physical property of the magnetostriction materialto adjust pixel density distribution of the image sensor.

In the technical solution provided in this embodiment of thisapplication, a specific structure and a connection manner of the imagesensor pixels and the controllable deformed material portion may bedetermined according to an actual need, and an actual manner is veryflexible.

In an optional implementation, as shown in FIG. 1 b, the controllabledeformed material portion 12 comprises a controllable deformed materiallayer 121. The multiple image sensor pixels 11 are array-distributed andconnected to one side of the controllable deformed material layer 121.Optionally, it is feasible to choose to directly from the multiple imagesensor pixels on the controllable deformed material portion 12 accordingto actual process conditions, or the multiple image sensor pixels andthe controllable deformed material portion 12 can be preparedrespectively and can be closely connected in a manner which comprises,but is not limited to, adhesion. The solution has a simple structure andis easy to achieve.

In another optional implementation, as shown in FIG. 1 c, thecontrollable deformed material portion 12 comprises multiplecontrollable deformed material connection sub-portions 122. The multiplecontrollable deformed material connection sub-portions 122 arearray-distributed, so as to correspondingly connect the multiple imagesensor pixels 11 array-distributed, that is, the multiple image sensorpixels array-distributed are connected into one piece based on themultiple controllable deformed material connection sub-portionsarray-distributed. Optionally, the multiple controllable deformedmaterial connecting sub-portions may be formed in space regions ofpixels of an image sensor pixel array according to an actual process,and the multiple controllable deformed material connecting sub-portionsand the corresponding image sensor pixels may be connected in a mannerwhich comprises, but is not limited to, abutment and adhesion. Densitydistribution of the image sensor pixels may be adjusted by controllingdeformation of the multiple controllable deformed material connectionsub-portions. the structure is simple and easy to implement.

Further, as shown in FIGS. 1 d and 1 e, the image sensor may furthercomprise a deformation control portion 13. The deformation controlportion 13 is configured to adjust distribution of the external fieldacting on the controllable deformed material portion 12, so as tocontrol the controllable deformed material portion 12 to producecorresponding deformation. In this way, when the controllable deformedmaterial portion 12 produces deformation, spacing between the imagesensor pixels 11 is adjusted correspondingly, thereby changing densitydistribution of the image sensor pixels 11, and achieving an effect ofgiving differentiated pixel point distribution to different regions ofthe image sensor according to actual requirements.

Optionally, as shown in FIG. 1d , the deformation control portion maycomprise a light-field control portion 131. The light-field controlportion 131 is configured to adjust distribution of an external lightfield acting on the controllable deformed material portion 12, so as tocontrol the controllable deformed material portion 12 to producecorresponding deformation. In this way, the controllable deformedmaterial portion 12 may comprise a photodeformation material portion atleast prepared from photodeformation materials, for example, thephotodeformation material portion may comprise a photodeformationmaterial layer at least prepared from the photodeformation materials, orthe controllable deformed material portion may comprise multiplephotodeformation material connecting sub-portions at least prepared fromthe photodeformation materials. The light-field control portion 131excites different regions of the controllable deformed material portion12 to produce deformation differently by changing light fielddistribution acting on the photodeformation material portion (in FIG. 1d, the light field with different intensity distribution acting on thecontrollable deformed material portion 12 is represented through arrowdensity), and the spacing between the image sensor pixels 11 is adjustedcorrespondingly through the deformation of the controllable deformedmaterial portion 12, thus changing pixel point distribution of the imagesensor pixels 11 and achieving the effect of giving differentiated pixelpoint distribution to different regions of the image sensor according toactual requirements.

Optionally, as shown in FIG. 1 e, the deformation control portion maycomprise an electric-field control portion 132. The electric-fieldcontrol portion 132 is configured to adjust distribution of an externalelectric field that is imposed on the controllable deformed materialportion, so as to control the controllable deformed material portion toproduce corresponding deformation. In this case, the controllabledeformed material portion 12 may comprise a piezoelectric materialportion at least prepared from piezoelectric materials (such as apiezoelectric material layer or a piezoelectric material connectingsub-portion), or the controllable deformed material portion 12 maycomprise an EAP portion at least prepared from EAPs (such as an EAPlayer or an EAP connecting sub-portion). As shown in FIG. 1 e, theelectric field control portion and the controllable deformed materialcan be connected through a control line, and the electric field controlportion 132 excites different regions of the controllable deformedmaterial portion 12 to produce deformation differently by changingelectric field distribution acting on the controllable deformed materialportion. If the electric field acting on the controllable deformedmaterial portion 12 is a zero field, the controllable deformed materialportion does not produce deformation (might as well be called zero fieldexcitation); if intensity distribution of the electric field acting onthe controllable deformed material portion 12 (for example, “+” positiveelectric field excitation and “−” negative electric field excitationshown in FIG. 1e ) is changed to cause the intensity of the electricfield acting on different regions of the controllable deformed materialportion 12 to vary, as shown in FIG. 1 f, in this way, the differentregions of the controllable deformed material portion 12 may producedeformation differently, and the spacing between the image sensor pixels11 is adjusted correspondingly through the deformation of thecontrollable deformed material portion 12, thus changing the overallpixel density distribution of the image sensor and achieving the effectof giving differentiated pixel density distribution to different regionsof the image sensor according to actual requirements.

In this embodiment of the present application, the controllable deformedportion and the deformation control portion may be directly connected,and may also be indirectly connected. The deformation control portionmay be a part of the image sensor, or the deformation control portionmay also not be a part of the image sensor, and the image sensor mayalso be connected with the deformation control portion through areserved pin or interface or the like. The external field acting on thecontrollable deformed material portion may comprise, but is not limitedto, an electric field, a magnetic field, a light field and the like. Ahardware or software structure configured to produce the electric field,a hardware or software structure configured to produce the magneticfield, a hardware or software structure configured to produce the lightfield and the like can be achieved based on corresponding existingtechnologies according to actual requirements, which is no longerrepeated herein in the embodiment of the present application.

Optionally, the image sensor may further comprise a flexible substrate.The flexible substrate may comprise, but is not limited to, a plasticflexible substrate, which has certain flexibility and can change theshape of the flexible substrate according to requirements. The imagesensor pixels and the controllable deformed material portion may bedisposed at the same side or different sides of the flexible substrate.For example, as shown in FIG. 1g , the multiple image sensor pixels 11are connected to one side of a flexible substrate 14, and thecontrollable deformed material portion (for example, the controllabledeformed material layer 121) is connected to the other side of theflexible substrate 14. For example, as shown in FIG. 1 h, the multipleimage sensor pixels 11 are connected to one side of the flexiblesubstrate 14, and the controllable deformed material portion (forexample, the controllable deformed material connection sub-portions 122)is connected to a corresponding image sensor pixel and is located at thesame side of the flexible substrate 14 with the image sensor pixels 11.The solution not only can indirectly adjust the overall pixel densitydistribution of the image sensor by controlling its deformation throughthe external field acting on the controllable deformed material portion,to achieve adjustable pixel density of the image sensor, but also canflexibly change the shape of the image sensor due to use of the flexiblesubstrate, for example, a plane image sensor is bent to a certain angleto obtain a surface image sensor, thus meeting application demands suchas diversified image acquisition and decoration.

FIG. 1i is a schematic structural diagram of a seventh image sensor withadjustable pixel density according to one embodiment of the presentapplication. In the image sensor as shown in FIG. 1 i, the controllabledeformed material portion 12 comprises a flexible substrate 123 andmultiple permeability magnetic material portions 124; the multiple imagesensor pixels 11 are respectively connected with the flexible substrate123, at least a part of the image sensor pixels 11 are connected withthe multiple permeability magnetic material portions 124, the flexiblesubstrate 123 produces corresponding deformation by changing a magneticfield acting on the permeability magnetic material portions 124, anddensity distribution of the multiple image sensor pixels 11 iscorrespondingly adjusted through the deformation. For example, apermeability magnetic material portion 124 can be disposed on a sideface of each image sensor pixel, and optionally, the image sensor pixel11 is respectively adhered to the flexible substrate 123 and thepermeability magnetic material portion 124. The permeability magneticmaterial portion may comprise a magnetic pole prepared from apermeability magnetic material, and the permeability magnetic materialmay comprise, but is not limited to, one or more of a soft magneticmaterial, a silicon steel sheet, a permalloy, ferrite, an amorphous softmagnetic alloy, and a super-microcrystalline soft magnetic alloy. Thepermeability magnetic material portion prepared from the soft magneticmaterial has better permeability, and small residual magnetization aftercancellation of the magnetic field facilitates next adjustment.

Further, optionally, the deformation control portion 13 in thisembodiment of the present application may further comprise amagnetic-field control portion 133. The magnetic-field control portion133 is configured to adjust distribution of an external magnetic fieldacting on the controllable deformed material portion, so as to controlthe controllable deformed material portion to produce correspondingdeformation. For example, when the magnetic field control portion 133controls the magnetic field (that is, excitation magnetic field) actingon the permeability magnetic material portion 124, as shown in FIG. 1 i,a like magnetic pole (NN or SS) repulsion magnetic field or an unlikemagnetic pole (NS or SN) attraction magnetic field with certain magneticfield intensity distribution is applied between adjacent image sensorpixels, the poles may produce a corresponding repelling force orattracting force therebetween, the magnetic force is transferred to theflexible substrate 123 to make the flexible substrate 123 producedeformation such as expansion and contraction, thereby resulting in thatthe spacing between the corresponding image sensor pixels changes andachieving the purpose of adjusting pixel density distribution of theimage sensor. The solution achieves adjustable pixel densitydistribution of the image sensor in combination with scalabledeformation characteristics of the flexible substrate and the magneticfield control principle.

FIG. 1j is a schematic structural diagram of an eighth image sensor withadjustable pixel density according to one embodiment of the presentapplication. In the image sensor as shown in FIG. 1 j, the controllabledeformed material portion 12 comprises a flexible substrate 123 andmultiple permeability magnetic material portions 124; one side of themultiple permeability magnetic material portions 124 is respectivelyconnected with the flexible substrate 123, an opposite face of themultiple permeability magnetic material portions 124 is respectivelyconnected with the multiple image sensor pixels 11 correspondingly, theflexible substrate 123 produces corresponding deformation by changing amagnetic field acting on the permeability magnetic material portions124, and density distribution of the multiple image sensor pixels 11 iscorrespondingly adjusted through the deformation. Optionally, thepermeability magnetic material portions 124 are adhered to the flexiblesubstrate 123, the image sensor pixels 11 are adhered to thepermeability magnetic material portions 124, and when the magnetic fieldacting on the permeability magnetic material portions 124 changes, themagnetic force is transferred to the flexible substrate 123 to make theflexible substrate 123 produce deformation such as expansion andcontraction, thereby achieving the purpose of adjusting pixel densitydistribution of the image sensor. The solution achieves adjustable pixeldensity distribution of the image sensor in combination with scalabledeformation characteristics of the flexible substrate and the magneticfield control principle.

It should be understood by those skilled in the art that, in any one ofthe foregoing methods of the specific implementations of the presentapplication, the value of the serial number of each step described abovedoes not mean an execution sequence, and the execution sequence of eachstep should be determined according to the function and internal logicthereof, and should not be any limitation to the implementationprocedure of the specific implementations of the present application.

FIG. 3 is a logic block diagram of a super-resolution image acquisitionapparatus according to one embodiment of the present application. Asshown in FIG. 3, a super-resolution image acquisition apparatus providedin this embodiment of the present application comprises an originalimage acquisition module 31, a pixel point distribution change module32, an adjustment image acquisition module 33, and a super-resolutionimage acquisition module 34.

The original image acquisition module 31 is configured to acquire animage of a to-be-shot scene by an image sensor.

The pixel point distribution change module 32 is configured to changepixel point distribution of the image sensor at least once.

The adjustment image acquisition module 33 is configured to separatelyacquire an image of the to-be-shot scene by the image sensor changedeach time.

The super-resolution image acquisition module 34 is configured toacquire a super-resolution image of the to-be-shot scene according tothe acquired images.

After the pixel point distribution change module 32 changes the pixelpoint distribution of the image sensor each time, the adjustment imageacquisition module 33 may be triggered to acquire an image of the samescene.

According to the technical solution provided in the embodiment of thepresent application, an image is acquired by an image sensor beforepixel point distribution is adjusted, then the pixel point distributionof the image sensor is changed at least once, and after each change, animage of the same scene is then separately acquired by the changed imagesensor. This is equivalent to acquiring a group of images of the samescene at different time periods, which are similar in content but notcompletely the same in acquired information about details. Asuper-resolution image may be generated by performing softwareprocessing such as fusing on this group of images, and resolution of thesuper-resolution image is higher than that of each image of the group ofimages. In view of this, according to the technical solutions providedin the embodiments of the present application, a super-resolution imagemay be acquired without using multiple cameras or multiple imagesensors, and the solutions are simple and easy to implement, and maybetter meet users' diversified actual application needs

The super-resolution image acquisition apparatus provided in thisembodiment of the present application may perform static or dynamicimage processing control by executing the super-resolution imageacquisition method during applications, which comprise, but are notlimited to, phototaking, camera shooting, photographing and videomonitoring. A device presentation form of the super-resolution imageacquisition apparatus is not limited, for example, the super-resolutionimage acquisition apparatus may be a separate part, and the partcooperates and communicates with an imaging device such as a camera, avideo camera, a mobile phone, or a wearable camera; or, thesuper-resolution image acquisition apparatus may be integrated into animaging device as a functional module, which is not limited in thisembodiment of the present application.

Optionally, as shown in FIG. 4, the pixel point distribution changemodule 32 comprises a first pixel point distribution adjustmentsub-module 321. The first pixel point distribution adjustment sub-module321 is configured to increase an average pixel point density of a firstimaging region of the image sensor at least once, where the firstimaging region is a part of an imaging region of the image sensor. Afterthe first pixel point distribution adjustment sub-module 321 changes thepixel point distribution of the image sensor each time, the adjustmentimage acquisition module 33 may be triggered to acquire an image of thesame scene.

The solution causes the number of pixel points in the first imagingregion of the image sensor to increase and the pixel points to bedistributed more densely, that is, an average pixel point density of thefirst imaging region increases. At this time, a sub-image, correspondingto the first imaging region, in an image of the same scene acquired bythe image sensor is richer in details and higher in resolution, whileresolution of other sub-images of the image is lower, thereby forming animage in which resolution is distributed variedly.

Optionally, the pixel point distribution change module 32 comprises asecond pixel point distribution adjustment sub-module 322. The secondpixel point distribution adjustment sub-module 322 is configured todecrease an average pixel point density of a first imaging region of theimage sensor at least once, where the first imaging region is a part ofan imaging region of the image sensor. After the second pixel pointdistribution adjustment sub-module 322 changes the pixel pointdistribution of the image sensor each time, the adjustment imageacquisition module 33 may be triggered to acquire an image of the samescene. According to the solution, pixel points in the first imagingregion of the image sensor are decreased, to cause pixel points in thefirst imaging region to be sparser, while an average pixel point densityof a second imaging region increases. A sub-image, corresponding to thefirst imaging region, in an image of the same scene acquired by theimage sensor is lower in resolution, while a sub-image corresponding toa second imaging region is richer in details and higher in resolution,thereby forming an image in which resolution is distributed variedly.

Optionally, the acquisition apparatus further comprises an imagingregion determination module 35. The imaging region determination module35 is configured to determine an imaging region, which corresponds to afirst region, of the image sensor, where the first region is a localpart of the to-be-shot scene. Correspondingly, the pixel pointdistribution change module 32 comprises a third pixel point distributionadjustment sub-module 323. The third pixel point distribution adjustmentsub-module 323 is configured to change pixel point distribution of thedetermined imaging region at least once. According to the solution, animaging region, corresponding to a local part of a to-be-shot scene, ofthe image sensor may be adjusted targetedly, so as to adjust pixel pointdistribution of the image sensor flexibly. Optionally, the third pixelpoint distribution adjustment sub-module 323 comprises a pixel pointdensity adjustment unit 3231. The pixel point density adjustment unit3231 is configured to increase an average pixel point density of thedetermined imaging region at least once. According to the solution, byincreasing an average pixel point density of the imaging region, imagingquality of a sub-image, corresponding to the imaging region, of an imageacquired by an image sensor after pixel point distribution is adjustedmay be improved.

Optionally, the acquisition apparatus further comprises a first regiondetermination module 36. The first region determination module 36 isconfigured to determine the first region. According to the solution, alocal part of a current to-be-shot scene may be predetermined as thefirst region according to an actual need, which may better meet users'personalized application needs.

Further, optionally, as shown in FIG. 5, the first region determinationmodule 36 comprises an ROI determination information acquisitionsub-module 361 and an ROI determining sub-module 362. The ROIdetermination information acquisition sub-module 361 is configured toacquire, based on a preview image of the image sensor about theto-be-shot scene, ROI determination information; and the ROI determiningsub-module 362 is configured to determine a region, corresponding to theROI determination information, of the to-be-shot scene as the firstregion. According to the solution, according to the ROI of the previewimage, a local part, corresponding to the ROI, of the to-be-shot sceneis determined as the first region, to cause determination of the firstregion to more fit in with actual user demands, thereby better meetingusers' personalized application demands.

Optionally, the first region determination module 36 comprises an imageanalysis sub-module 363 and a first region determination sub-module 364.The image analysis sub-module 363 is configured to perform an imageanalysis on a preview image of the image sensor about the to-be-shotscene; and the first region determination sub-module 364 is configuredto determine the first region according to a result of the imageanalysis. According to the solution, a region, corresponding thereto, ofthe to-be-shot scene may be determined as the first region according toan image analysis result of the preview image, to cause determination ofthe first region to be more intelligent, thereby improving efficiencyand universality of the determination of the first region.

FIG. 6 is a structural block diagram of another super-resolution imageacquisition apparatus according to one embodiment of the presentapplication. A specific implementation of a super-resolution imageacquisition apparatus 700 is not limited in a specific embodiment of thepresent application. As shown in FIG. 6, the super-resolution imageacquisition apparatus 600 may comprise:

a processor 610, a communications interface 620, a memory 630, and acommunications bus 640.

The processor 610, the communications interface 620, and the memory 630communicate with each other through the communications bus 640.

The communications interface 620 is configured to communicate with adevice having a communications function, an external light source, andthe like.

The processor 610 is configured to execute a program 632, andspecifically, may execute a related step in any one of the foregoingembodiments of the light-field acquisition control method.

For example, the program 632 may comprise a program code. The programcode comprises a computer operation instruction.

The processor 610 may be a central processing unit (CPU) or anapplication specific integrated circuit (ASIC), or may be configured asone or more integrated circuits that implement the embodiments of thepresent application.

The memory 630 is configured to store the program 632. The memory 630may comprise a random access memory (RAM), and may also comprise anon-volatile memory, for example, at least one magnetic disk storage.

For example, in an optional implementation, the processor 610 mayexecute the following steps by executing the program 632: acquiring animage of a to-be-shot scene by an image sensor; changing pixel pointdistribution of the image sensor at least once; separately acquiring animage of the to-be-shot scene by the image sensor changed each time; andacquiring a super-resolution image of the to-be-shot scene according tothe acquired images.

In another optional implementation, the processor 610 may also execute astep in any one of the foregoing other embodiments by executing theprogram 632, which is not described herein again.

Reference can be made to corresponding description in the correspondingsteps, modules, sub-modules and units in the embodiments for specificimplementation of the steps in the program 632, which is not repeatedherein. Those skilled in the art can clearly understand that, referencecan be made to the corresponding process description in the methodembodiments for the devices described above and the specific workingprocedures of the modules, and will not be repeated herein in order tomake the description convenient and concise.

Optionally, the image sensor of any camera may be the flexible imagesensor described above. Alternatively, the image sensor may furthercomprise: multiple image sensor pixels array-distributed; and acontrollable deformed material portion respectively connected with themultiple image sensor pixels; wherein the controllable deformed materialportion can produce deformation under the action of an external field,and density distribution of the multiple image sensor pixels iscorrespondingly adjusted through the deformation; the external field iscontrolled by the imaging control apparatus.

Reference can be made to the corresponding description in FIG. 1b toFIG. 1j for the structure of the image sensor, the super-resolutionimage acquisition apparatus can directly control the external field tocontrol deformation of the controllable deformed material portion,thereby adjusting pixel point distribution of the corresponding imagesensor; or the super-resolution image acquisition apparatus canindirectly control the external field by controlling the deformationcontrol portion, to cause the controllable deformed material portion toproduce corresponding deformation to correspondingly adjust pixel pointdistribution of the image sensor; and so on. A manner of physicalconnection between the image sensor pixels and the deformed materialportion can be determined according to actual needs, as long as themanner can meet that pixel density distribution of the image sensor canbe adjusted when the deformed material portion produces deformation,which is not limited in the embodiment of the present application, andreference can be made to the corresponding description above for aspecific implementation thereof, which is not repeated herein.

In the various embodiments of the present application, the serialnumbers and/or sequence numbers of the foregoing embodiments are merelyfor the convenience of description, and do not imply the preferenceamong the embodiments. Particular emphasis is put on the descriptionabout each embodiment, and reference can be made to relevant descriptionof other embodiments for the content not detailed in a certainembodiment. Reference can be made to the description about thecorresponding method embodiments for related description about theimplementation principle or process of relevant apparatus, device orsystem embodiments, which is not repeated herein.

It can be appreciated by those of ordinary skill in the art that,exemplary units and method steps described with reference to theembodiments disclosed in this specification can be implemented byelectronic hardware or a combination of computer software and electronichardware. Whether these functions are executed by hardware or softwaredepends on specific applications and design constraints of the technicalsolution. Those skilled in the art may use different methods toimplement the described functions for each specific application, butsuch implementation should not be construed as a departure from thescope of the present application.

If the function is implemented in the form of a software functional unitand is sold or used as an independent product, the product can be storedin a computer-readable storage medium. Based on such understanding, thetechnical solution of the present application essentially, or the partthat contributes to the prior art, or a part of the technical solutionmay be embodied in the form of a software product; the computer softwareproduct is stored in a storage medium and comprises several instructionsfor enabling a computer device (which may be a personal computer, aserver, a network device, or the like) to execute all or some of thesteps of the method in the embodiments of the present application. Theforegoing storage medium comprises various mediums capable of storingprogram codes, such as, a USB flash drive, a removable hard disk, aread-only memory (ROM), a random access memory (RAM), a magnetic disk oran optical disc.

In the embodiments of the apparatus, method, and system of the presentapplication, apparently, the parts (a system, a subsystem, a module, asub-module, a unit, a subunit, and the like) or steps may be decomposedor combined, and/or decomposed first and then combined. Thesedecomposition and/or combination should be considered as equivalentsolutions of the present application. In the above descriptions of thespecific embodiments of the present application, a feature describedand/or shown for one implementation may be used in one or more of otherimplementations in the same or similar manner and combined with afeature in another implementation, or replace a feature in anotherimplementation.

It should be emphasized that, terms “comprise/contain” used herein referto existence of a feature, an element, a step, or a component, but donot exclude existence or addition of one or more of other features,elements, steps, or components.

Finally, it should be noted that, the foregoing implementation mannersare only used to describe the present application, but not to limit thepresent application. Those of ordinary skill in the art can still makevarious alterations and modifications without departing from the spiritand scope of the present application; therefore, all equivalenttechnical solutions also fall within the scope of the presentapplication, and the patent protection scope of the present applicationshould be subject to the claims.

1. A super-resolution image acquisition method, comprising: acquiring animage of a scene by an image sensor; changing pixel point distributionof the image sensor at least once; separately acquiring an image of thescene by the image sensor with changed pixel point distribution; andacquiring a super-resolution image of the scene according to theacquired images.
 2. The acquisition method of claim 1, wherein thechanging pixel point distribution of the image sensor at least oncecomprises: increasing an average pixel point density of a first imagingregion of the image sensor at least once, wherein the first imagingregion is a part of an imaging region of the image sensor.
 3. Theacquisition method of claim 1, wherein the changing pixel pointdistribution of the image sensor at least once comprises: decreasing anaverage pixel point density of a first imaging region of the imagesensor at least once, wherein the first imaging region is a part of animaging region of the image sensor.
 4. The acquisition method of claim2, wherein after pixel point distribution of the image sensor is changedat least once, pixel points within the first imaging region aredistributed evenly or unevenly.
 5. The acquisition method of claim 2,wherein the first imaging region comprises multiple imaging sub-regions,wherein the multiple imaging sub-regions are distributed dispersivelywithin the image sensor.
 6. The acquisition method of claim 1, whereinthe acquisition method further comprises: determining an imaging region,which corresponds to a first region, of the image sensor, wherein thefirst region is a local part of the scene; and the changing pixel pointdistribution of the image sensor at least once comprises changing pixelpoint distribution of the determined imaging region at least once. 7.The acquisition method of claim 6, wherein the changing pixel pointdistribution of the determined imaging region at least once comprises:increasing an average pixel point density of the determined imagingregion at least once.
 8. The acquisition method of claim 6, wherein theacquisition method further comprises: determining the first region. 9.The acquisition method of claim 8, wherein the determining the firstregion comprises: acquiring region of interest (ROI) determinationinformation based on a preview image of the image sensor about thescene; and determining a region, corresponding to the ROI determinationinformation, of the scene as the first region.
 10. The acquisitionmethod of claim 8, wherein the determining the first region comprises:performing an image analysis on a preview image of the image sensorabout the scene; and determining the first region according to a resultof the image analysis.
 11. A super-resolution image acquisitionapparatus, comprising: an original image acquisition module, configuredto acquire an image of a scene by an image sensor; a pixel pointdistribution change module, configured to change pixel pointdistribution of the image sensor at least once; an adjustment imageacquisition module, configured to separately acquire an image of thescene by the image sensor with changed pixel point distribution; and asuper-resolution image acquisition module, configured to acquire asuper-resolution image of the scene according to the acquired images.12. The super-resolution image acquisition apparatus of claim 11,wherein the pixel point distribution change module comprises: a firstpixel point distribution adjustment sub-module, configured to increasean average pixel point density of a first imaging region of the imagesensor at least once, wherein the first imaging region is a part of animaging region of the image sensor.
 13. The super-resolution imageacquisition apparatus of claim 11, wherein the pixel point distributionchange module comprises: a second pixel point distribution adjustmentsub-module, configured to decrease an average pixel point density of afirst imaging region of the image sensor at least once, wherein thefirst imaging region is a part of an imaging region of the image sensor.14. The super-resolution image acquisition apparatus of claim 11,wherein the acquisition apparatus further comprises an imaging regiondetermination module, configured to determine an imaging region, whichcorresponds to a first region, of the image sensor, wherein the firstregion is a local part of the scene; and the pixel point distributionchange module comprises a third pixel point distribution adjustmentsub-module, configured to change pixel point distribution of thedetermined imaging region at least once.
 15. The super-resolution imageacquisition apparatus of claim 14, wherein the third pixel pointdistribution adjustment sub-module comprises: a pixel point densityadjustment unit, configured to increase an average pixel point densityof the determined imaging region at least once.
 16. The super-resolutionimage acquisition apparatus of claim 14, wherein the acquisitionapparatus further comprises: a first region determination module,configured to determine the first region.
 17. The super-resolution imageacquisition apparatus of claim 16, wherein the first regiondetermination module comprises: a region of interest (ROI) determinationinformation acquisition sub-module, configured to acquire ROIdetermination information based on a preview image of the image sensorabout the scene; and an ROI determination sub-module, configured todetermine a region, corresponding to the ROI determination information,of the scene as the first region.
 18. The super-resolution imageacquisition apparatus of claim 16, wherein the first regiondetermination module comprises: an image analysis sub-module, configuredto perform an image analysis on a preview image of the image sensorabout the scene; and a first region determination sub-module, configuredto determine the first region according to a result of the imageanalysis.
 19. A computer readable storage apparatus, comprising at leastone executable instruction, which, in response to execution, causes asuper-resolution image acquisition method, comprising: acquiring animage of a scene by an image sensor; changing pixel point distributionof the image sensor at least once; separately acquiring an image of thescene by the image sensor changed each time; and acquiring asuper-resolution image of the scene according to the acquired images.20. A super-resolution image acquisition apparatus, comprising aprocessor and a memory, the memory storing computer executableinstructions, the processor being connected to the memory through acommunication bus, and when the processor executes the computerexecutable instructions stored in the memory, it causes the apparatus toperform: acquiring an image of a scene by an image sensor; changingpixel point distribution of the image sensor at least once; separatelyacquiring an image of the scene by the image sensor changed with changedpixel point distribution; and acquiring a super-resolution image of thescene according to the acquired images.